Thats why I don't let my SO's in on what I can do anymore. I feel like you might be right in that the slightest energetic presence can be felt, or even distorted.
I did a remote viewing on my ex one time since she wanted me to, and I did and got what she asked right. Afterwards, she started getting really paranoid that I was watching her all the time or in the shower or something.
Displaying my meta "abilities" to people always ends up biting me in the ass.